OpenRouter

OpenRouter is a unified interface for commercial and open-source models, giving you access to the best models at the best prices. You can sign up here, create your API key on the keys page, and then choose a model from the list of supported models.

Change ~/.continue/config.json to look like the following. Since OpenRouter is fully API compatible with OpenAI, it is recommended to stick with "provider": "openai", even if they aren't necessarily the upstream provider.

~/.continue/config.json

{
  "models": [
    {
      "title": "OpenRouter LLaMA 70 8B",
      "provider": "openai",
      "model": "meta-llama/llama-3-70b-instruct",
      "apiBase": "https://openrouter.ai/api/v1",
      "apiKey": "..."
    }
  ]
}

To utilize features such as provider preferences or model routing configuration, include these parameters inside the models[].requestsOptions.extraBodyProperties field of your plugin config.

For example, to prevent extra long prompts from being compressed, you can explicitly turn off the feature like so:

~/.continue/config.json

{
  "models": [
    {
      ...
      "requestOptions": {
        "extraBodyProperties": {
          "transforms": []
        }
      }
    }
  ]
}

Learn more about available settings here.